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We claim: 

1 . A method of encoding Vibstantially imperceptible auxiliary information into a 
video signal including at least one video object, the method comprising: 

steganographically encoding p^^t information about the video object into the 
video signal; and 

associating the object informatbn With an action, where the action is performed in 
response to user selection of the video objecis^hrough a user interface while the video 
signal is playing. 

2. The method of claim 1 wliferein the video signal is steganographically encoded 
with at least two identifiers, each identifier corresponding to distinct video objects in 
frames of the video signal, and each identifier being associated with actions relating to 
the corresponding video objects. 

3. The method of claim 1 wherein the object information is encoded in a 
watermark signal that covers a portion of screen 2^ea of frames in the video signal where 
the video object is located. 

4. The method of claim 1 wherein object information for at least two different 
video objects in the video signal is steganographically entoded in different portions of 
frames of the video signals where the corresponding video objects are located. 

5. The method of claim 1 wherein the object information includes a screen 
location information indicating where the video object is locatedin the video signal. 



6. The method of claim 5 wherein object information is encoded for at least two 
different video objects in the video signal, and the object information includes location 
information indicating where the video objects are located in the video signal. 
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7. The method ofclaim 1 wherein the object information is encoded in a pre- 
recorded video object, whicla forms part of the video signal. 

8. The method of claim \ wherein the pre-recorded video object is composited 
5 with video frames to form the videb signal. 

9. The method ofclaim 7 wherein the pre-recorded video object is composited 
with at least one other video object to foma the video signal, where the video objects are 
each steganographically encoded with object^ specific information. 

10 

t«i 10. The method of claim 1 wherein the ^ideo object is encoded with the object 

O information as part of a process of capturing the video signal of physical objects, and the 
hfe \ 

SI object information pertains to the physical objects captured in the video signal. 

m 



CO 15 11. The method ofclaim 10 wherein the object information is encoded as part of 

a process of capturing the video signal during a live broadcast or transmission of the 



video signal. 



12. The method of claim 10 wherein object information is encoded for at least 
20 two different video objects depicted in frames of the video signal. 



13. The method of claim 1 wherein object information is encoded lor at least two 
different video objects such that the object information is synchronized with\ 
corresponding video objects depicted in the video signal during playback. 




14. A method for using a watemiark encoded into a video signal or in an audio 
track accompanying the video signal^ wM^ the watermark comprises information 
regarding a video object in the video simai$^t^ comprising: 

decoding the watermark informi 
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receiving a user sel^tion of the video object; and 

executing an action associated with the video object information. 

15. The method of claim M wherein the video signal includes watermark 
information for at least two differentVideo objects in the video signal, and the watermark 
information associates the video objects\with object actions or information. 
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16. The method of claim 15 wherein\he audio track includes watermark 
information for at least two different video obj^ts appearing in the same frames of the 
video signal, and the watermark information associates the video objects with object 
specific actions or information. 

17. A system for creatingVatermark enabled video objects comprising: 
an encoder for encoding a wkermark in a video sequence or accompanying audio 

track corresponding to a video object or objects in the video sequence; and 

a database system for associating\the watermark with an action or information 
such that the watermark is operable to link^the video object or objects to a related action 
or information during playback of the vid^6s^q^h)^ 

18. The system of claim 17 wher^n thp^vS^termark ftsoperable to link a 
corresponding video object to an action oMnforman^n when a user selects the video 
object during playback of the video sequence 



19. The system of claim 17 wherein the encoder encodes a video object with a 
25 watermark and composites the encoded video object with ancither video signal to create 
the video sequence. 



20. A system for processing a watermark enabled video object in a video signal 
comprising: 



SWS:lmp P0509 12/13/01 



39 



EXPRESS MAIL EV050294700US 



a watermark decis)der for decoding a watermark carrying object specific 
information from the video, signal and linking object specific information to an action or 
information; and \ 

a rendering system for rendering the action or information. 

21. The system of claim 20 including a user interface for enabling a user to select 
a watermark enabled video object during playback of the video signal. 
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22. The system of claim 21 whereiirthe user interface includes the rendering 
system for rendering the action or informadoir9f the selected video object. 

A > 

23. The system of claim 21 wherein the useK^interface is in a separate device from 
the watermark decoder. 




24. The system of claim 20 including a network interface for communicating 
information decoded from a watermark to a remote device, which in response to the 
information, links the information to an action or additional infocpiation about a video 
object. 

25. A method for encoding subkantially imperceptible auxiliary information into 
an audio track of a video signal includingy^t least one video object, the method 
comprising: 

steganographically encoding object specific information about the video object 
into the audio track; and 

associating the object specific informationVith an action, where the action is 
performed in response to user selection of the video o|)ject through a user interface while 
the video signal is playing. 
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26. The method of claim 25 wherein the object specific information includes an 
identifier and screen location of the video object. 



27. The method of claim 25swherein the object specific information includes 
information for at least two different video objects. 
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